Performance assessment in brain-computer interface-based augmentative and alternative communication

Abstract A large number of incommensurable metrics are currently used to report the performance of brain-computer interfaces (BCI) used for augmentative and alterative communication (AAC). The lack of standard metrics precludes the comparison of different BCI-based AAC systems, hindering rapid growth and development of this technology. This paper presents a review of the metrics that have been used to report performance of BCIs used for AAC from January 2005 to January 2012. We distinguish between Level 1 metrics used to report performance at the output of the BCI Control Module, which translates brain signals into logical control output, and Level 2 metrics at the Selection Enhancement Module, which translates logical control to semantic control. We recommend that: (1) the commensurate metrics Mutual Information or Information Transfer Rate (ITR) be used to report Level 1 BCI performance, as these metrics represent information throughput, which is of interest in BCIs for AAC; 2) the BCI-Utility metric be used to report Level 2 BCI performance, as it is capable of handling all current methods of improving BCI performance; (3) these metrics should be supplemented by information specific to each unique BCI configuration; and (4) studies involving Selection Enhancement Modules should report performance at both Level 1 and Level 2 in the BCI system. Following these recommendations will enable efficient comparison between both BCI Control and Selection Enhancement Modules, accelerating research and development of BCI-based AAC systems.http://deepblue.lib.umich.edu/bitstream/2027.42/115465/1/12938_2012_Article_658.pd

Detection of Event-Related Spectral Changes in Electrocorticograms

The University of Michigan Direct Brain Interface (UM-DBI) project seeks to detect voluntarily produced electrocortical activity (ECoG) related to actual or imagined movements in humans as the basis for a DBI. In past work we have used cross-correlation based template matching (CCTM) as the method for detecting event-related potentials (ERPs). That approach ignores event-related spectral changes in the ECoG signal. This paper discusses model-based signal detection methods that exploit event-related spectral changes. In particular we propose a quadratic detector based on a two-class hypothesis test with different covariances for the two classes. The covariance matrices are generated by fitting autoregressive (AR) models to training data. Preliminary results show that the quadratic detector yields more channels with good detection performance than the CCTM method, particularly when we impose constraints on detection delay.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/85984/1/Fessler209.pd

Preliminary psychometric properties of a standard vocabulary test administered using a non-invasive brain-computer interface

ObjectiveTo examine measurement agreement between a vocabulary test that is administered in the standardized manner and a version that is administered with a brain-computer interface (BCI).MethodThe sample was comprised of 21 participants, ages 9–27, mean age 16.7 (5.4) years, 61.9% male, including 10 with congenital spastic cerebral palsy (CP), and 11 comparison peers. Participants completed both standard and BCI-facilitated alternate versions of the Peabody Picture Vocabulary Test - 4 (PPVT™-4). The BCI-facilitated PPVT-4 uses items identical to the unmodified PPVT-4, but each quadrant forced-choice item is presented on a computer screen for use with the BCI.ResultsMeasurement agreement between instruments was excellent, including an intra-class correlation coefficient of 0.98, and Bland-Altman plots and tests indicating adequate limits of agreement and no systematic test version bias. The mean standard score difference between test versions was 2.0 points (SD 6.3).ConclusionThese results demonstrate that BCI-facilitated quadrant forced-choice vocabulary testing has the potential to measure aspects of language without requiring any overt physical or communicative response. Thus, it may be possible to identify the language capabilities and needs of many individuals who have not had access to standardized clinical and research instruments

MYND: Unsupervised Evaluation of Novel BCI Control Strategies on Consumer Hardware

Neurophysiological studies are typically conducted in laboratories with limited ecological validity, scalability, and generalizability of findings. This is a significant challenge for the development of brain-computer interfaces (BCIs), which ultimately need to function in unsupervised settings on consumer-grade hardware. We introduce MYND: A framework that couples consumer-grade recording hardware with an easy-to-use application for the unsupervised evaluation of BCI control strategies. Subjects are guided through experiment selection, hardware fitting, recording, and data upload in order to self-administer multi-day studies that include neurophysiological recordings and questionnaires. As a use case, we evaluate two BCI control strategies ("Positive memories" and "Music imagery") in a realistic scenario by combining MYND with a four-channel electroencephalogram (EEG). Thirty subjects recorded 70.4 hours of EEG data with the system at home. The median headset fitting time was 25.9 seconds, and a median signal quality of 90.2% was retained during recordings.Neural activity in both control strategies could be decoded with an average offline accuracy of 68.5% and 64.0% across all days. The repeated unsupervised execution of the same strategy affected performance, which could be tackled by implementing feedback to let subjects switch between strategies or devise new strategies with the platform.Comment: 9 pages, 5 figures. Submitted to PNAS. Minor revisio

Psychological distress, depression, anxiety and life satisfaction following COVID-19 infection: Evidence from 11 UK longitudinal population studies

Background: Evidence on associations between COVID-19 illness and mental health is mixed. We aimed to examine whether COVID-19 is associated with deterioration in mental health while considering pre-pandemic mental health, time since infection, subgroup differences, and confirmation of infection via self-reported test and serology data. Methods: We obtained data from 11 UK longitudinal studies with repeated measures of mental health (psychological distress, depression, anxiety, and life satisfaction; mental health scales were standardised within each study across time) and COVID-19 status between April, 2020, and April, 2021. We included participants with information available on at least one mental health outcome measure and self-reported COVID-19 status (suspected or test-confirmed) during the pandemic, and a subset with serology-confirmed COVID-19. Furthermore, only participants who had available data on a minimum set of covariates, including age, sex, and pre-pandemic mental health were included. We investigated associations between having ever had COVID-19 and mental health outcomes using generalised estimating equations. We examined whether associations varied by age, sex, ethnicity, education, and pre-pandemic mental health, whether the strength of the association varied according to time since infection, and whether associations differed between self-reported versus confirmed (by test or serology) infection. Findings: Between 21 Dec, 2021, and July 11, 2022, we analysed data from 54 442 participants (ranging from a minimum age of 16 years in one study to a maximum category of 90 years and older in another; including 33 200 [61·0%] women and 21 242 [39·0%] men) from 11 longitudinal UK studies. Of 40 819 participants with available ethnicity data, 36 802 (90·2%) were White. Pooled estimates of standardised differences in outcomes suggested associations between COVID-19 and subsequent psychological distress (0·10 [95% CI 0·06 to 0·13], I2=42·8%), depression (0·08 [0·05 to 0·10], I2=20·8%), anxiety (0·08 [0·05 to 0·10], I2=0·0%), and lower life satisfaction (–0·06 [–0·08 to –0·04], I2=29·2%). We found no evidence of interactions between COVID-19 and sex, education, ethnicity, or pre-pandemic mental health. Associations did not vary substantially between time since infection of less than 4 weeks, 4–12 weeks, and more than 12 weeks, and were present in all age groups, with some evidence of stronger effects in those aged 50 years and older. Participants who self-reported COVID-19 but had negative serology had worse mental health outcomes for all measures than those without COVID-19 based on serology and self-report. Participants who had positive serology but did not self-report COVID-19 did not show association with mental health outcomes. Interpretation: Self-reporting COVID-19 was longitudinally associated with deterioration in mental health and life satisfaction. Our findings emphasise the need for greater post-infection mental health service provision, given the substantial prevalence of COVID-19 in the UK and worldwide. Funding: UK Medical Research Council and UK National Institute for Health and Care Research

Living alone and mental health: parallel analyses in UK longitudinal population surveys and electronic health records prior to and during the COVID-19 pandemic

BACKGROUND: People who live alone experience greater levels of mental illness; however, it is unclear whether the COVID-19 pandemic had a disproportionately negative impact on this demographic. OBJECTIVE: To describe the mental health gap between those who live alone and with others in the UK prior to and during the COVID-19 pandemic. METHODS: Self-reported psychological distress and life satisfaction in 10 prospective longitudinal population surveys (LPSs) assessed in the nearest pre-pandemic sweep and three periods during the pandemic. Recorded diagnosis of common and severe mental illnesses between March 2018 and January 2022 in electronic healthcare records (EHRs) within the OpenSAFELY-TPP. FINDINGS: In 37 544 LPS participants, pooled models showed greater psychological distress (standardised mean difference (SMD): 0.09 (95% CI: 0.04; 0.14); relative risk: 1.25 (95% CI: 1.12; 1.39)) and lower life satisfaction (SMD: −0.22 (95% CI: −0.30; −0.15)) for those living alone pre-pandemic. This gap did not change during the pandemic. In the EHR analysis of c.16 million records, mental health conditions were more common in those who lived alone (eg, depression 26 (95% CI: 18 to 33) and severe mental illness 58 (95% CI: 54 to 62) more cases more per 100 000). For common mental health disorders, the gap in recorded cases in EHRs narrowed during the pandemic. CONCLUSIONS: People living alone have poorer mental health and lower life satisfaction. During the pandemic, this gap in self-reported distress remained; however, there was a narrowing of the gap in service use. CLINICAL IMPLICATIONS: Greater mental health need and potentially greater barriers to mental healthcare access for those who live alone need to be considered in healthcare planning

A systematic review of the effectiveness and cost-effectiveness of peer education and peer support in prisons.

BACKGROUND: Prisoners experience significantly worse health than the general population. This review examines the effectiveness and cost-effectiveness of peer interventions in prison settings. METHODS: A mixed methods systematic review of effectiveness and cost-effectiveness studies, including qualitative and quantitative synthesis was conducted. In addition to grey literature identified and searches of websites, nineteen electronic databases were searched from 1985 to 2012. Study selection criteria were: Population: Prisoners resident in adult prisons and children resident in Young Offender Institutions (YOIs). INTERVENTION: Peer-based interventions Comparators: Review questions 3 and 4 compared peer and professionally led approaches. OUTCOMES: Prisoner health or determinants of health; organisational/ process outcomes; views of prison populations. STUDY DESIGNS: Quantitative, qualitative and mixed method evaluations. RESULTS: Fifty-seven studies were included in the effectiveness review and one study in the cost-effectiveness review; most were of poor methodological quality. Evidence suggested that peer education interventions are effective at reducing risky behaviours, and that peer support services are acceptable within the prison environment and have a positive effect on recipients, practically or emotionally. Consistent evidence from many, predominantly qualitative, studies, suggested that being a peer deliverer was associated with positive effects. There was little evidence on cost-effectiveness of peer-based interventions. CONCLUSIONS: There is consistent evidence from a large number of studies that being a peer worker is associated with positive health; peer support services are also an acceptable source of help within the prison environment and can have a positive effect on recipients. Research into cost-effectiveness is sparse. SYSTEMATIC REVIEW REGISTRATION: PROSPERO ref: CRD42012002349

Estimating Grizzly and Black Bear Population Abundance and Trend in Banff National Park Using Noninvasive Genetic Sampling

We evaluated the potential of two noninvasive genetic sampling methods, hair traps and bear rub surveys, to estimate population abundance and trend of grizzly (Ursus arctos) and black bear (U. americanus) populations in Banff National Park, Alberta, Canada. Using Huggins closed population mark-recapture models, we obtained the first precise abundance estimates for grizzly bears ( = 73.5, 95% CI = 64–94 in 2006;  = 50.4, 95% CI = 49–59 in 2008) and black bears ( = 62.6, 95% CI = 51–89 in 2006;  = 81.8, 95% CI = 72–102 in 2008) in the Bow Valley. Hair traps had high detection rates for female grizzlies, and male and female black bears, but extremely low detection rates for male grizzlies. Conversely, bear rubs had high detection rates for male and female grizzlies, but low rates for black bears. We estimated realized population growth rates, lambda, for grizzly bear males ( = 0.93, 95% CI = 0.74–1.17) and females ( = 0.90, 95% CI = 0.67–1.20) using Pradel open population models with three years of bear rub data. Lambda estimates are supported by abundance estimates from combined hair trap/bear rub closed population models and are consistent with a system that is likely driven by high levels of human-caused mortality. Our results suggest that bear rub surveys would provide an efficient and powerful means to inventory and monitor grizzly bear populations in the Central Canadian Rocky Mountains